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Abstract: The goal of thi s comparati ve study was to expl ore the 
online interactions among members of two learning communi- 
ties. The two cases examined two different cohorts in the same 
professional preparation program for school principals and 
administrators: a distanced earningcohort and an onsiteuniver- 
sity-district partnership cohort in which on line activities sup- 
ported face-to-face instructional delivery. Of interest herewas 
how students wrestled together to interpret, understand, and 
support their learning process within the online environment. 
Becausethecontent and instructor remained consistent in both 
sample cohorts, the differing modes of instructional delivery 
offered a u n i queopportu n i ty for a compa rati vestudy. T h i s pa per 
reports prel i mi nary anal yses of thecontent of onl i neexchanges 
amongcohort membersof thetwolearning communities, gener- 
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ated during the first semester (leadership domain) of the pro- 
gram. 

In higher education, instructional technology often supplements 
traditional instruction and is gradually, yet consistently, viewed as a 
primary mode of total content delivery. In such online environments, 
learni ng is shifted from a teacher-centered model i n which the i nstructor 
is the source of knowledge to a learner-centered model in which peer 
support, interaction, and collaboration areemphasized (Harasim, 1990; 
Lebow, 1993). As universities increasi nglyuselearni ng networks, faculty 
and students alike need to understand how online interactions support 
academic success in distanced earningenvironments(Browne-Ferrigno, 
Muth, & Choi, 2000; Choi, 2001; Cox, 1999) 

The goal of this comparative study was to explore the online 
interactions among members of two learning communities. The two 
cases examined were two different cohorts in the same professional 
preparation programfor school pri nci pals and admi nistrators: a distance- 
learning(DL) cohort and an onsite university-district partnership (U DP) 
cohort where online activities supported face-to-face instructional deliv- 
ery. The phenomenon of i nterest was how students wrestled together to 
interpret, understand, and support their learning process within the 
online environment. Because the content and instructor remained 
consistent in both sample cohorts, the differing mode of instructional 
delivery offered a unique opportunity for a comparative study. 

Context 

Professional preparation of school principals and administrators in 
the State of Colorado is mandated legislatively. The Administrative 
Leadershi p and Pol icy Studies (AL PS) Di vision of theSchool of Education 
at the U ni versity of Colorado at Denver is based at one of seven higher 
education i nstitutions currently authorized by the statetooffer training 
for aspi ri ng school pri nci pals and admi nistrators. T o paral lei the state's 
adoption of professional standardsinl994,theALPS faculty progressively 
revised its leadership education program into a problem-based (Ford, 
Martin, Muth, & Steinbrecher, 1997), active-learning (Muth, 1999), 
portfolio-assessed (Muth, Murphy, Martin, & Sanders, 1996) model. 

This principal licensing program is structured upon principles of 
transformational leadership and empowerment, developed through prac- 
titioner experience and reflection and expanded through intellectual 
consciousness (Napier, 2000). Thecurriculum integrates problem-based 
learning and action research, exploration of problems of practicethrough 
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group projects, online mentoring and instruction, and personal reflection 
(Muth, 2002). Students progress through a sequence of four learning 
domains that concentrate on specific areas of school administration and 
connect to concurrent field internships. Individual and group activities 
within the domains or "content umbrellas" (M uth, 2000, p. 60) center on 
four broad topics: (a) leadership studies; (b)school environment, includ- 
ing I aw andfi nance; (c) su pervi si on of curricul um and instruction; and (d) 
school improvement. Mastery of learning is demonstrated through self- 
constructed portfolios (Muth et al ., 2001) with artifacts created through 
cohort activities. 

Characteristics of the Cohorts 

The two cohorts compared in this study used a closed cohort 
structure, keeping students together as a group throughout the entire 
program (Barnett & Muse, 1993; Basom, Yerkes, Norris, & Barnett, 
1995; Teitel, 1995). The closed cohort provides evolving, adaptable 
learningenvironments,thusempoweringpartici pantsthrough the prac- 
tical application of knowledge and the integration of personal and 
professional experiences in their own learning (Napier & Lowry, 1999). 
One of the goals of the closed cohort structure is to foster ongoing peer 
support and professional col I egiality (Barnett, Basom, Yerkes, & Norris, 
2000) whilemeetingtheuniqueneeds of adult students (Mahoney, 1991). 

Although both cohorts shared the overal I program goal , each used a 
different mode of delivery to encourage and facilitate I earning. Thefirst 
cohort in this comparative study was a distance-learning (DL) principal 
licensing cohort. Almost the entire instruction in the DL cohort was 
del i vered through onl i neexchanges usi ng a Web-accessi bleconferenci ng 
software system, FirstClass Client (www.centricity.com). The second 
cohort, supported by an onsite university-district partnership (UDP), 
used FirstClass to deliver about 30% of its instructional activities. For 
both cohorts, the FirstClass communication system allowed private e- 
mail, "synchronous as well as asynchronous communications, easy file 
sharing, and I nternet access" (M uth, 2000, p. 60). Through itsdiscussion 
sites, known as "conferences, "cohort participants could post questions, 
comments, and responses to be viewed by all conference members. 

DistanceLearning Cohort: Virtual Learning Community 

T o serve i ncreasi ng demands for graduate I i censi ng programs from 
rural and semi-rural areas across the state, theALPS division launched 
its distance-learning, principal licensing cohort, modeled after its pro- 
gressive, face-to-face program. Participants in the DL cohort were 
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required to attend an eight-day orientation on the university campus 
during the initial summer and to return the following summer at the 
conclusion of the instructional activities. During the orientation, cohort 
partici pants grou pedthemsel vesi n smal I , supportivecl uster groups of five 
or six students, determined largely by geographic locale. These cluster 
groups were directed to communicate at the discretion of the members 
throughout theenti reprogram. This organization advanced onegoal of the 
open i ng, face-to-face or i entat i on , encou ragi ng grou p i nteract i on to "bu i I d 
a shared culture for a strong cohort and effective cl uster groups" (Muth, 
2000, p. 65). Theconcludingthree-day,face-to-facesessi on heldon campus 
was devoted to preparation for the required state examination, portfolio 
defense, program evaluation, and a cohort-closing celebration. 

Almost all instruction and group discussion in the DL cohort was 
conducted electronically through FirstClass. For this study, available 
sources of data about onl i nei nteraction i ncl uded (a)open cohort conference 
discussions, (b) partici pants' responsesandi nteractionsrel ativetoinstruc- 
tional activities and questions, and (c) evidence of other online behaviors 
such as participation in subconferences and chat-room discussions. 

University-District Partnership Cohort: Onsite Learning Community 

An urban school district based in a community within a short distance 
of Denver faced multiple environmental challenges, including (a) state- 
mandated accountability measures and the accompanying political and 
public scrutiny of student scores and school report cards, (b) limited 
resources for implementing school renewal measures, and (c) a poorly 
devel oped, economi cal I y stressed commu n i ty support base. I n addi ti on , the 
district immediately neededtodevel op administrativetalenttoalleviateits 
current shortageof potential school principalsand administrators, particu- 
larly at thesecondary level. Thus, a new partnership was formed between 
ALPS and this urban school district to sponsor the U DP cohort. 

Consistent with theDL cohort, sources of online interaction data in 
the UDP cohort included: (a) open cohort conference discussions, (b) 
participants’ responses and interactions relative to instructional activi- 
ties and questions, and (c) evidence of other online behaviors such as 
participation in subconferences and chat-room discussions. 

Comparative Methodology 

The learning activities during the first domain of both principal- 
preparation cohorts focused on leadership knowledge and ski 1 1 develop- 
ment asspecified in twoofthesixstatestandards (Colorado Department 
of Education, 1997): 'The principal leads and supports a school commu- 
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nitythat iscommittedtoand focuses on I earning" (Standard 2), and 'The 
pri nci pal behaves ethical I y and creates an envi ronment that encourages 
and develops responsibility, ethics, and citizenship in self and others" 
(Standard3). Further, theactivities supported an underlying premise of 
thestate's Standards for School P ri nci palsthat pri nci pals and administra- 
tors recognize their roles in schools and are confident of their abilities to 
lead those schools into the future. 

The online interactions among participants in the two cohorts 
allowed comparisons of the virtual communication patterns used by a 
distance-learning cohort and an onsite cohort to build learning commu- 
nities. The phenomena analyzed in this comparative inquiry were the 
type and content (Weber, 1990) of posted messages. The analysis of 
message type differentiated between non-responded messages and 
threaded discussions. For initiated messages that evolved intothreaded 
discussions, the message type classified connecting patterns of the 
response messages and identified the last message posted within the 
discussi on. Theanalysisof messagecontent identified specific references 
within the body of posted messages as described below. 

Analysis Matrix and Coding Key 

A mat r i x f or a n a I ysi s of on I i ne messages was devel oped col I a bor at i vel y 
by the team of investigators, and analysis was conducted using the 
guidelines outlined by Miles and Huberman (1994). The coding key 
i nci uded symbols for (a) thetypeof posted message and (b) thecontent of 
the message (seeTables 1 and 2). 

The display format for messages in FirstClass allows a viewer to 
discern quickly the differences between threaded discussions and non- 
responded messages. Therefore, we were able to begin with the first 
message posted in the leadership "conference" (a discussion site) and 
classify messages either as a non-responded message (M ), to which no 


Tablel 

Codi ng key for M essageT ype 


Code 

Description 

1 

Initiated message 

R 

Response (in general) 

Ri 

Response to initiator message 

Rr 

Response to respondent message 

C 

Close of threaded discussion (last message) 

Ci 

Closed as response to initiator message 

Cr 

Closed as response to respondent message 
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Table2 

Coding Key for Message Content 
Code Description 

a Referencetoassignment(clarification, redirection, reminder, wrap-up) 
g Greeting and/or closing 

n Suggestion for action 

o Refer encetoanother message in 5700* confer enceand/or subconference 

c Reference to cohort activities and/or studies 
p Reference to personal matter and/or personal message 
r Reference to professional responsibilities and/or experiences; 
s Self disclosure: I agree, I believe, I disagree, I feel, I found, I think 
t Referenceto technical support and/or trouble 

L Referencetoleadershiptheory and/or practice 

Note: 5700 indicates the course number for leadership domain 


written reply was made, or as a group of messages within a threaded 
discussion (T). All files within a threaded discussion were linked and 
coded as onethreaded discussion. The messages were coded as either M 
orT and numbered in chronological order by date, beginning with thefi rst 
message to appear i n the conference. 

Dates of initiated messages and closing responses in threaded 
di scussions were recorded i n theanalysis matrix. The FirstCI ass system 
posted messages within a conference based upon the date of the last 
response within a threaded discussion. Non-responded messages were 
I isted as endi ng on the date the message was posted. F urther, threaded 
discussionswereposted in chronological order accordingtothedateofthe 
last message in the thread. Including the dates of the message postings 
allowed analysis of change in message content over time. Permission to 
analyze online messages was obtained from all participants in both 
cohorts according to university human subjects requirements. 

GuidingAssumptions 

Assumptionsguidingthiscomparativestudy of cohort connectedness 
defi nedthe messagecoding keys used duringtheanalysis phase. Thefi rst 
assumption was that online interactions that fostered self-disclosure of 
personal matters and allowed personal sharing would be more prevalent 
in the onsite cohort than in thedistance-learning cohort. Opportunities 
to engage in personal, face-to-face interaction with cohort members, we 
hypothesized, would generate feelings of familiarity that engendered 
trust. Additional ly, cohort normsthat supported peer-to-peer encourage- 
ment, as evidenced by the intensity and volume of peer-to-peer interac- 
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tions, were expected to be different in the two learning communities. 
Thus, coding keys for message content included identification of refer- 
ences to personal matters or personal messages. A code for marking 
personal greetings or closings was added as a means to assess the level 
of personal connection to other cohort members. 

In addition, the analysis also identified who initiated messages that 
transformed into threaded discussions to determine whether the mes- 
sages were instructor initiated or student generated. Message content 
codes were used to i dent i fy references to sel f-di scl osu re statements ( i .e. , 
statements that began with the words "I agree, ""I disagree,""! believe," 
"I think") and to identify expressive and humor-infused interaction. 

Another underlying assumption was that, despite training for both 
cohorts in the use of FirstClass, students would report uncertainty or 
confusion about using FirstClass during the early days of both cohorts. 
Therefore, as students struggled to learn how tocommunicate with this 
technology, they would offer peer support which would encourage cohort 
connectedness. Thus, a message content code was created to identify 
references to technical support or to trouble with or uncertainty about 
using FirstClass. 

Some Surprising Findings 

A cursory scan of online exchanges within the two leadership confer- 
ences indicated that the cohorts engaged in markedly different types of 
virtual communication during the beginning phases of each program. 
Based upon the analysis of the online exchanges, findings suggest that 
opportunitiestoengageregularly in personal, face-to-face interacti on with 
other cohort members i ncreased the level of cohort connectedness withi n 
the onsite cohort when compared to the onl i ne cohort. 

Technical Support Postings 

Referencestotechnical supportortroubleappearedin27(51%)ofthe 
53 DL cohort messages. Eleven of these were non-responded messages 
generated by the cohort instructor. Six were threaded discussions 
initiated by different students with only the instructor responding. Only 
two of the threaded discussions in the DL conference were initiated by 
students and responded to by peers. 

Bycontrast, referencestotechnical support ortroubleappearedin 14 
(9%) of the 159 U DP cohort messages. Three of the instructor-generated 
non-responded messages link technical support toanother assignment. 
Eight student references to uncertai nty about F i rstCI assappeared within 
both non-responded messages and threaded discussions among students 
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during the first two weeks of the assigned online activity. The last 
reference to technical trouble made by a student responded to an 
instructor's message about completing an online assignment. In this 
instance, thestudentwrotethat hewasunabletopartici pateinoneofthe 
online activities because the system was off-line when he tried to 
complete his work. 

Although students enrol led in both the DL and U DP cohorts received 
training in the use of the university’s electronic communication system 
prior to beginning online activities, data indicated that students in both 
cohorts reported technical difficulties and received guidance from the 
instructor as well as their peers throughout the entire timeframe exam- 
ined. Whi le it may be tempting to assume from the statistics that the DL 
cohort experi enced and reported greater diffi culty usi ngtheonl i necommu- 
nication system than the UDP cohort did, UDP student responses to a 
questionnaire about using FirstClass suggested otherwise. Sixty-five 
percent (65%) of the respondents stated that they did not encounter major 
difficulties usi ng F i rstCI ass. F urther, the range of chal lengesfor theother 
respondents included not being able to log-on because of an incorrectly 
spelled user name to simply needing additional assistance from the 
F i rstClass admi nistrator or a technical I y adept spouse. 

One student reported significant difficulty and did not engage in 
online activities until two weeks after the assignment had been made. 
Once she learned to use the electronic communication system, she 
participated as actively as the majority of her peers. 

I almostdied learningFirstClass. Ittooksa/eral weekstofeel comfortable 
understanding and using the system. I first had to get hooked uptoan 
I nternet provider, thentoa search enginetobeabletouseonmylaptop.Then 
I had to I oad F i rstC I ass. .. [and ] I earn how tonavi gatearou nd i n thesystem. 
Thedass names wereeven foreign. I worked and worked until I became 
comforta bl eusi ng thesystem. 

Another student voiced a different type of frustration: 

I wouldhavelikedmoreimmediatefeedback. I fdtlikel wasthrowing ideas 
to noonein particular. Probablyyearsof"Pavlovian"conditioninghasleft 
mehungryforan immediateresponse. 

Leadership Domain Exchanges 

Only 53 files wereposted in the leadership domain of theDL cohort. 
Thirty-three (62%) of those messages were instructor-generated. Con- 
verse! y, al though the UDP cohort met together as a group al most weekl y, 
the cohort generated a total of 159 files in its leadership conference. Of 
those 159 entries, only 20 (13%) wereposted by the instruct or. Up tothis 
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point, the data record strongly suggested that online interaction within 
the DL cohort would be academically based and less personally linked 
when compared to the active nature of online communication among 
members of the UDP cohort. The intensity and volume of peer-to-peer 
i nter actions within the conference exchanges suggest that peer-to-peer 
support and encouragement developed more quickly in the UDP cohort 
than in the DL cohort. 

In addition, the structure of the DL cohort was such that 
"subconferences" were created to house peer-to-peer exchanges among 
geographicclustergroupsduringtheduration of the leadership domain. 
Further investigation of the DL cluster-group subconferences revealed 
another interesting set of findings. Evidence of collaboration and peer 
support emerged more frequently in the cluster-group subconferences 
than in the general DL conference. While one cluster group created as 
few as 35 messages, another exchanged 344 messages duri ng the enti re 
program. The other three cluster groups generated 83, 67, and 64 
messages. Although the content of the messages was academically 
driven, cohort members included personal matters as they related to 
their participation and performance. I n one cluster group, cohort mem- 
bers began toseek peer support i n terms of cl arif i cati on and open sharing. 
Additionally, members were "checking-in" with each other and fre- 
quently i nqui red about peers who had withdrawn from active partici pa- 
tion in their virtual community. 

WhereisK ? I knewshewashavingsometroublewith her computer 

but. . . It'snotlikehernottobeintouch. 

Analysis of the U DP student messages, on the other hand, showed 
I i mited i n ci den ce of personal shari ngor personal messages unti I the26th 
message in the sequence. The student who initiated the threaded 
discussion began her reflection with a quotefrom Leading from Within 
about the "...[spiritual] gift availableto all whotakeon inner journey" 
(Parker, 1999, p. 87). She then wrote, 

I nthechaosof my husband losi nghisjob, losingour house, starting again 
at forty years of ageand having two active teenagers, I came back to life 
(literally becausel was confined to bed with Lupus). 

This student's bold risk-taking initiated the UDP cohort's norm on 
personal sharing within reflections about the assigned readings. Two 
responses focus on peer-to-peer support and reference their own ti mesof 
chaos (e.g., a parent's recent death and another parent's confinement to 
a nursing home). Other students then began to share openly their 
spiritual and rel i gi ous con victions, and these werediscussed and debated 
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over several weeks. Some students also disclosed their struggles with 
drug and alcohol use as teenagers and their reactions to divorce. 
Nevertheless, their personal sharing stayed connected to the content of 
theassigned readi ngs, suggesti ngthat these exchanges faci I itated reflec- 
tive responses to the cohort's leadershi p studies. 

Implications 

Electronic communication networks in colleges and universities 
worldwide increasingly expand opportunities for collaboration among 
faculty and students (H olden & Wedman, 1993; Picciano, 2001). Members 
of virtual communities use dialogue to learn, reflect, debate, critique, 
share, give feedback, question, answer, and engage in multiple other 
communicative behaviors (Henri, 1992; Mason, 1994). Further, through 
opportunitiestoengageonlinein social negotiation of concepts and ideas, 
learners can seek solutions to problems of practice from multiple 
perspectives (Muth et al., 2001). Thus, information technology has 
potential tobecome "a permanent, respected, and increasingly essential 
component of the college experience" (Green, 1996, p. 24). 

Asfindingsofthis investigation show, onlinecommuni cation among 
learnerscan provide mutual supportandstimulatesharingof ideasand 
information, risk-takingandreflectingon practice, and I earningthrough 
cooperative efforts (Anderson & Lee, 1995; Bonk & King, 1998; Ryan, 
Hodson, & AM, 2004). The adoption of information technology in 
educational communities creates shifting roles for both instructors and 
students (Beller & Or, 1998; Bonk & King, 1998; Collison, Elbaum, 
Haavind, & Tinker, 2000; Picciano, 2001). Learning by doing and by 
sharing information and ideas in a virtual world allows the instructor 
to facilitate and guide rather than dispense knowledge through lectur- 
ing and tel ling. 

However, this "guide on the side" (Beller & Or, 1998; Cifuentes, 
1997) approach to collaborative learning raises questions about the 
quality and experience of virtual learning. Cyber-learning skeptics 
warn that technology may offer a falseor artificial senseof I earning that 
diminishesindividual capacityandleadstofragmentation (Heim, 1993). 
P roponents of i nstructi onal del i very through technology mai ntai n that 
computers promote learni ng becausethey al low ampleti me for qual ity 
feedback, provide a buffer for those less adept i n face-to-face communi- 
cations, and enhance spontaneity (Bresler, 1990; Collison et al., 2000; 
Meyer, 2003). Somefi ndi ngs suggest that learning in vi rtual communi- 
ties increases creative flow and collaborative possibilities (Bonk & 
King, 1998; Knox-Quinn, 1993). These and other findings suggest that 
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morestudy is needed todeterminethe best ways to build online learning 
communities. 

Questions for Further Discussion 

A few questions about building learning communities arose from the 
findings ofthiscomparativeinquiry. Oneconcern relates to engagement 
of students in online activities. Data cl early show that not all students in 
the two cohorts readily embraced the idea of actively participating in 
asynchronous online dialogue. While some students in theUDP cohort 
reported enjoying online activities, several revealed their reticence for 
sharing personal views and reflections in the public domain of an online 
conference. Further, three UDP students posted three or fewer mes- 
sages among a total of 139 student files, and four of the students in the 
DL cohort never posted a message within the leadership domain. If 
collaborative sharing is a key element of online student learning, is it 
i mportant for all students to parti ci pateinelectronicactivities?lfso,then 
what accountability measures does an instructor need to use to ensure 
student engagement? 

Another question concernsonl i neconferenci ng and student I earni ng 
styles. In face-to-face classroom situations, some students are very 
willingtosharetheirthoughtsand ideas openlyas fuel for discussion and 
debate among peers. Other students prefer to I isten and observe class- 
room exchanges and then i ntrospecti vely reflect about what wassai d. An 
instructor can observe facia I expressionsandbodylanguagetodiscern if 
quiet students are engaged in the classroom activity and even elicit 
responses through direct questioning. In a virtual environment, how- 
ever, an instructor cannot always discern if "quiet" students are actively 
participating. Even the fact that a message has been opened does not 
mean that it has been read. Taking account of different learning styles, 
what strategies can an instructor use to promote active student partici- 
pation in onl i ne acti viti es? Fulfillingthe promise of online learning may 
depend on our efforts to find answers to such questions about the role of 
online interactions in student learning and educational success. 
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